Efficient Search in Hidden Text of Large DjVu Documents
Identifieur interne : 000485 ( Main/Exploration ); précédent : 000484; suivant : 000486Efficient Search in Hidden Text of Large DjVu Documents
Auteurs : S. Bie [Pologne]Source :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2011.
Abstract
Abstract: The paper describes an open-source tool which allows to present end-users with results of advanced language technologies. It relies on the DjVu format, which for some applications is still superior to other modern formats including PDF/A. The DjVu GPLed tools are not limited just to the DjVuLibre library, but are being supplemented by various new programs, such as pdf2djvu developed by Jakub Wilk. It allows in particular to convert to DjVu the PDF output of popular OCR programs like FineReader preserving the hidden text layer and some other features. The tool in question has been conceived by the present author and consist of a modification of the Poliqarp corpus query tool, used for National Corpus of Polish; his ideas have been very succesfully implemented by Jakub Wilk. The new system, called here simply Poliqarp for DjVu, inherits from its origin not only the powerfull search facilities based two-level regular expressions, but also the ability to represent low-level ambiguities and other linguistic phenomena. Although at present the tool is used mainly to facilitate access to the results of dirty OCR, it is ready to handle also more sophisticated output of linguistic technologies.
Url:
DOI: 10.1007/978-3-642-23160-5_1
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: 000038
- to stream Istex, to step Curation: 000038
- to stream Istex, to step Checkpoint: 000142
- to stream Main, to step Merge: 000491
- to stream Main, to step Curation: 000485
Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Efficient Search in Hidden Text of Large DjVu Documents</title><author><name sortKey="Bie, S" sort="Bie, S" uniqKey="Bie S" first="S." last="Bie">S. Bie</name></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:581E72E881CAECD879C3315121A02F7180C6D578</idno><date when="2011" year="2011">2011</date><idno type="doi">10.1007/978-3-642-23160-5_1</idno><idno type="url">https://api.istex.fr/document/581E72E881CAECD879C3315121A02F7180C6D578/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">000038</idno><idno type="wicri:Area/Istex/Curation">000038</idno><idno type="wicri:Area/Istex/Checkpoint">000142</idno><idno type="wicri:doubleKey">0302-9743:2011:Bie S:efficient:search:in</idno><idno type="wicri:Area/Main/Merge">000491</idno><idno type="wicri:Area/Main/Curation">000485</idno><idno type="wicri:Area/Main/Exploration">000485</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Efficient Search in Hidden Text of Large DjVu Documents</title><author><name sortKey="Bie, S" sort="Bie, S" uniqKey="Bie S" first="S." last="Bie">S. Bie</name><affiliation wicri:level="1"><country xml:lang="fr">Pologne</country><wicri:regionArea>Formal Linguistics Department, University of Warsaw, Browarna 8/10, 00-927, Warszawa</wicri:regionArea><wicri:noRegion>Warszawa</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Pologne</country></affiliation></author></analytic><monogr></monogr><series><title level="s">Lecture Notes in Computer Science</title><imprint><date>2011</date></imprint><idno type="ISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="ISSN">0302-9743</idno></series><idno type="istex">581E72E881CAECD879C3315121A02F7180C6D578</idno><idno type="DOI">10.1007/978-3-642-23160-5_1</idno><idno type="ChapterID">1</idno><idno type="ChapterID">Chap1</idno></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">0302-9743</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Abstract: The paper describes an open-source tool which allows to present end-users with results of advanced language technologies. It relies on the DjVu format, which for some applications is still superior to other modern formats including PDF/A. The DjVu GPLed tools are not limited just to the DjVuLibre library, but are being supplemented by various new programs, such as pdf2djvu developed by Jakub Wilk. It allows in particular to convert to DjVu the PDF output of popular OCR programs like FineReader preserving the hidden text layer and some other features. The tool in question has been conceived by the present author and consist of a modification of the Poliqarp corpus query tool, used for National Corpus of Polish; his ideas have been very succesfully implemented by Jakub Wilk. The new system, called here simply Poliqarp for DjVu, inherits from its origin not only the powerfull search facilities based two-level regular expressions, but also the ability to represent low-level ambiguities and other linguistic phenomena. Although at present the tool is used mainly to facilitate access to the results of dirty OCR, it is ready to handle also more sophisticated output of linguistic technologies.</div></front></TEI><affiliations><list><country><li>Pologne</li></country></list><tree><country name="Pologne"><noRegion><name sortKey="Bie, S" sort="Bie, S" uniqKey="Bie S" first="S." last="Bie">S. Bie</name></noRegion><name sortKey="Bie, S" sort="Bie, S" uniqKey="Bie S" first="S." last="Bie">S. Bie</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/OcrV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000485 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000485 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= OcrV1
|flux= Main
|étape= Exploration
|type= RBID
|clé= ISTEX:581E72E881CAECD879C3315121A02F7180C6D578
|texte= Efficient Search in Hidden Text of Large DjVu Documents
}}
| This area was generated with Dilib version V0.6.32. |  |